Statistical Modeling of Expert Ratings on Medical Treatment Appropriateness

نویسنده

  • S. UEBERSAX
چکیده

This article uses latent structure analysis to model ordered category ratings by multiple experts on the appropriateness of indications for the medical procedure carotid endarterectomy. The statistical method used is a form of located latent class analysis, which combines elements of latent class and latent trait analysis. It assumes that treatment indications fall into distinct latent classes, with each latent class corresponding to a different level of appropriateness. The appropriateness rating of a treatment indication by a rater is assumed determined by the latent class membership of the indication, rating category thresholds of the rater, and random measurement error. The located latent class model has two alternative forms: a normal ogive form, which derives from the assumption of normally distributed measurement error, and a logistic approximation to the normal form. The approach has the following advantages for the analysis of ordered category ratings by multiple experts: ( 1 ) it assesses whether different raters base ratings on the same or different criteria; ( 2 ) it assesses rater bias-the tendency of some raters to make higher or lower ratings than others; ( 3 ) it characterizes rater differences in rating category definitions; ( 4 ) it provides theoretically based methods for combining the ratings of different raters; and ( 5 ) it provides a description of the distribution of the latent trait. The data examined are appropriateness ratings on 848 indications for carotid endarterectomy made by nine medical experts. The located latent class approach provides unique insights concerning the data. It identifies what appears to be a set of clear nonindications for carotid endarterectomy, but a corresponding set of clear indications is not evident. The results indicate that all raters measured a common latent trait of treatment appropriateness, but that some measured the trait better than others. Rater differences in overall bias and rating category definitions are evident. Two methods are used to combine raters' ratings. One uses ratings to calculate a continuous appropriateness score for each indication. The other uses ratings to assign indications to discrete outcome categories, each corresponding to a specific level of appropriateness. The located latent class approach for ordered category measures has possible applications besides the analysis of expert ratings, such as item analysis. Potential extensions of the model are discussed.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Expert panel vs decision-analysis recommendations for postdischarge coronary angiography after myocardial infarction.

CONTEXT Expert panels and decision-analytic techniques are increasingly used to determine the appropriateness of medical interventions, but these 2 approaches use different methods to process evidence. OBJECTIVE To compare expert panel appropriateness ratings of coronary angiography after myocardial infarction (from the time of hospital discharge to 12 weeks after infarction) with the health ...

متن کامل

ACR Appropriateness Criteria® definitive therapy for early-stage cervical cancer.

OBJECTIVES The definitive treatment of early-stage cervical cancer involves multidisciplinary decision making. This expert panel was convened to reach consensus on the selection of appropriate therapies based on patient and disease characteristics at presentation. METHODS The American College of Radiology Appropriateness Criteria are evidence-based guidelines for specific clinical conditions ...

متن کامل

Panellist consistency in the assessment of medical appropriateness.

Where information about the appropriateness of a surgical procedure is lacking, expert panels have been used to establish guidelines for medical practitioners. Such a panel was convened to assess the appropriateness of percutaneous transluminal coronary angioplasty and coronary artery bypass graft surgery in the Netherlands. The panel, consisting of interventional cardiologists and cardiothorac...

متن کامل

ACR Appropriateness Criteria® management of locoregionally advanced squamous cell carcinoma of the vulva.

OBJECTIVES Locoregionally advanced vulvar cancer (LRAVC) is a rare disease that presents many challenging medical decisions. An expert panel was convened to reach consensus on the most appropriate pretreatment assessment and therapeutic interventions in LRAVC patients. METHODS The American College of Radiology Appropriateness Criteria are evidenced-based guidelines for specific clinical condi...

متن کامل

Setting standards for effectiveness: a comparison of expert panels and decision analysis.

OBJECTIVE To compare criteria for coronary revascularization developed by the expert panel process and by decision analysis. METHOD We reviewed the medical records of 3080 chronic stable angina patients who either underwent coronary artery bypass graft surgery (CABG) or percutaneous transluminal coronary angioplasty (PTCA) and determined the agreement between appropriateness ratings made by t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1993